Arbitration between model-free and model-based control is not affected by transient changes in tonic serotonin levels.

BACKGROUND: Serotonin has been suggested to modulate decision-making by influencing the arbitration between model-based and model-free control. Disruptions in these control mechanisms are involved in mental disorders such as drug dependence or obsessive-compulsive disorder. While previous reports indicate that lower brain serotonin levels reduce model-based control, it remains unknown whether increases in serotonergic availability might thus increase model-based control. Moreover, the mediating neural mechanisms have not been studied yet. AIM: The first aim of this study was to investigate whether increased/decreased tonic serotonin levels affect the arbitration between model-free and model-based control. Second, we aimed to identify the underlying neural processes. METHODS: We employed a sequential two-stage Markov decision-task and measured brain responses during functional magnetic resonance imaging in 98 participants in a randomized, double-blind cross-over within-subject design. To investigate the influence of serotonin on the balance between model-free and model-based control, we used a tryptophan intervention with three intervention levels (loading, balanced, depletion). We hypothesized that model-based behaviour would increase with higher serotonin levels. RESULTS: We found evidence that neither model-free nor model-based control were affected by changes in tonic serotonin levels. Furthermore, our tryptophan intervention did not elicit relevant changes in Blood-Oxygenation-Level Dependent activity.

Analysis of individual differences in neurofeedback training illuminates successful self-regulation of the dopaminergic midbrain.

The dopaminergic midbrain is associated with reinforcement learning, motivation and decision-making - functions often disturbed in neuropsychiatric disorders. Previous research has shown that dopaminergic midbrain activity can be endogenously modulated via neurofeedback. However, the robustness of endogenous modulation, a requirement for clinical translation, is unclear. Here, we examine whether the activation of particular brain regions associates with successful regulation transfer when feedback is no longer available. Moreover, to elucidate mechanisms underlying effective self-regulation, we study the relation of successful transfer with learning (temporal difference coding) outside the midbrain during neurofeedback training and with individual reward sensitivity in a monetary incentive delay (MID) task. Fifty-nine participants underwent neurofeedback training either in standard (Study 1 N = 15, Study 2 N = 28) or control feedback group (Study 1, N = 16). We find that successful self-regulation is associated with prefrontal reward sensitivity in the MID task (N = 25), with a decreasing relation between prefrontal activity and midbrain learning signals during neurofeedback training and with increased activity within cognitive control areas during transfer. The association between midbrain self-regulation and prefrontal temporal difference and reward sensitivity suggests that reinforcement learning contributes to successful self-regulation. Our findings provide insights in the control of midbrain activity and may facilitate individually tailoring neurofeedback training.

Feasibility and utility of amygdala neurofeedback.

Amygdala NeuroFeedback (NF) have the potential of being a valuable non-invasive intervention tool in many psychiatric disporders. However, the feasibility and best practices of this method have not been systematically examined. The current article presents a review of amygdala-NF studies, an analytic summary of study design parameters, and examination of brain mechanisms related to successful amygdala-NF performance. A meta-analysis of 33 publications showed that real amygdala-NF facilitates learned modulation compared to control conditions. In addition, while variability in study dsign parameters is high, these design choices are implicitly organized by the targeted valence domain (positive or negative). However, in most cases the neuro-behavioral effects of targeting such domains were not directly assessed. Lastly, re-analyzing six data sets of amygdala-fMRI-NF revealed that successful amygdala down-modulation is coupled with deactivation of the posterior insula and nodes in the Default-Mode-Network. Our findings suggest that amygdala self-modulation can be acquired using NF. Yet, additional controlled studies, relevant behavioral tasks before and after NF intervention, and neural 'target engagement' measures are critically needed to establish efficacy and specificity. In addition, the fMRI analysis presented here suggest that common accounts regarding the brain network involved in amygdala NF might reflect unsuccessful modulation attempts rather than successful modulation.

The effects of multi-echo fMRI combination and rapid T2*-mapping on offline and real-time BOLD sensitivity.

A variety of strategies are used to combine multi-echo functional magnetic resonance imaging (fMRI) data, yet recent literature lacks a systematic comparison of the available options. Here we compare six different approaches derived from multi-echo data and evaluate their influences on BOLD sensitivity for offline and in particular real-time use cases: a single-echo time series (based on Echo 2), the real-time T2*-mapped time series (T2*FIT) and four combined time series (T2*-weighted, tSNR-weighted, TE-weighted, and a new combination scheme termed T2*FIT-weighted). We compare the influences of these six multi-echo derived time series on BOLD sensitivity using a healthy participant dataset (N = 28) with four task-based fMRI runs and two resting state runs. We show that the T2*FIT-weighted combination yields the largest increase in temporal signal-to-noise ratio across task and resting state runs. We demonstrate additionally for all tasks that the T2*FIT time series consistently yields the largest offline effect size measures and real-time region-of-interest based functional contrasts and temporal contrast-to-noise ratios. These improvements show the promising utility of multi-echo fMRI for studies employing real-time paradigms, while further work is advised to mitigate the decreased tSNR of the T2*FIT time series. We recommend the use and continued exploration of T2*FIT for offline task-based and real-time region-based fMRI analysis. Supporting information includes: a data repository (https://dataverse.nl/dataverse/rt-me-fmri), an interactive web-based application to explore the data (https://rt-me-fmri.herokuapp.com/), and further materials and code for reproducibility (https://github.com/jsheunis/rt-me-fMRI).

Predictors of real-time fMRI neurofeedback performance and improvement - A machine learning mega-analysis.

Real-time fMRI neurofeedback is an increasingly popular neuroimaging technique that allows an individual to gain control over his/her own brain signals, which can lead to improvements in behavior in healthy participants as well as to improvements of clinical symptoms in patient populations. However, a considerably large ratio of participants undergoing neurofeedback training do not learn to control their own brain signals and, consequently, do not benefit from neurofeedback interventions, which limits clinical efficacy of neurofeedback interventions. As neurofeedback success varies between studies and participants, it is important to identify factors that might influence neurofeedback success. Here, for the first time, we employed a big data machine learning approach to investigate the influence of 20 different design-specific (e.g. activity vs. connectivity feedback), region of interest-specific (e.g. cortical vs. subcortical) and subject-specific factors (e.g. age) on neurofeedback performance and improvement in 608 participants from 28 independent experiments. With a classification accuracy of 60% (considerably different from chance level), we identified two factors that significantly influenced neurofeedback performance: Both the inclusion of a pre-training no-feedback run before neurofeedback training and neurofeedback training of patients as compared to healthy participants were associated with better neurofeedback performance. The positive effect of pre-training no-feedback runs on neurofeedback performance might be due to the familiarization of participants with the neurofeedback setup and the mental imagery task before neurofeedback training runs. Better performance of patients as compared to healthy participants might be driven by higher motivation of patients, higher ranges for the regulation of dysfunctional brain signals, or a more extensive piloting of clinical experimental paradigms. Due to the large heterogeneity of our dataset, these findings likely generalize across neurofeedback studies, thus providing guidance for designing more efficient neurofeedback studies specifically for improving clinical neurofeedback-based interventions. To facilitate the development of data-driven recommendations for specific design details and subpopulations the field would benefit from stronger engagement in open science research practices and data sharing.

Targeting hippocampal hyperactivity with real-time fMRI neurofeedback: protocol of a single-blind randomized controlled trial in mild cognitive impairment.

BACKGROUND: Several fMRI studies found hyperactivity in the hippocampus during pattern separation tasks in patients with Mild Cognitive Impairment (MCI; a prodromal stage of Alzheimer's disease). This was associated with memory deficits, subsequent cognitive decline, and faster clinical progression. A reduction of hippocampal hyperactivity with an antiepileptic drug improved memory performance. Pharmacological interventions, however, entail the risk of side effects. An alternative approach may be real-time fMRI neurofeedback, during which individuals learn to control region-specific brain activity. In the current project we aim to test the potential of neurofeedback to reduce hippocampal hyperactivity and thereby improve memory performance. METHODS: In a single-blind parallel-group study, we will randomize n = 84 individuals (n = 42 patients with MCI, n = 42 healthy elderly volunteers) to one of two groups receiving feedback from either the hippocampus or a functionally independent region. Percent signal change of the hemodynamic response within the respective target region will be displayed to the participant with a thermometer icon. We hypothesize that only feedback from the hippocampus will decrease hippocampal hyperactivity during pattern separation and thereby improve memory performance. DISCUSSION: Results of this study will reveal whether real-time fMRI neurofeedback is able to reduce hippocampal hyperactivity and thereby improve memory performance. In addition, the results of this study may identify predictors of successful neurofeedback as well as the most successful regulation strategies. TRIAL REGISTRATION: The study has been registered with clinicaltrials.gov on the 16th of July 2019 (trial identifier: NCT04020744 ).

Questioning the role of amygdala and insula in an attentional capture by emotional stimuli task.

Our senses are constantly monitoring the environment for emotionally salient stimuli that are potentially relevant for survival. Because of our limited cognitive resources, emotionally salient distractors prolong reaction times (RTs) as compared to neutral distractors. In addition, many studies have reported fMRI blood oxygen level-dependent (BOLD) activation of both the amygdala and the anterior insula for similar valence contrasts. However, a direct correlation of trail-by-trial BOLD activity with RTs has not been shown, yet, which would be a crucial piece of evidence to relate the two observations. To investigate the role of the above two regions in the context of emotional distractor effects, we study here the correlation between BOLD activity and RTs for a simple attentional capture by emotional stimuli (ACES) choice reaction time task using a general linear subject-level model with a parametric RT regressor. We found significant regression coefficients in the anterior insula, supplementary motor cortex, medial precentral regions, sensory-motor areas and others, but not in the amygdala, despite activation of both insula and amygdala in the traditional valence contrast across trials (i.e., negative vs. neutral pictures). In addition, we found that subjects that exhibit a stronger RT distractor effect across trials also show a stronger BOLD valence contrast in the right anterior insula but not in the amygdala. Our results indicate that the current neuroimaging-based evidence for the involvement of the amygdala in RT slowing is limited. We advocate that models of emotional capture should incorporate both the amygdala and the anterior insula as separate entities.

Risk-seeking for losses is associated with 5-HTTLPR, but not with transient changes in 5-HT levels.

RATIONALE: Serotonin (5-HT) plays a key role in different aspects of value-based decision-making. A recent framework proposed that tonic 5-HT (together with dopamine, DA) codes future average reward expectations, providing a baseline against which possible choice outcomes are compared to guide decision-making. OBJECTIVES: To test whether high 5-HT levels decrease loss aversion, risk-seeking for gains, and risk-seeking for losses. METHODS: In a first session, 611 participants were genotyped for 5-HTTLPR and performed a mixed gambles (MGA) task and two probability discounting tasks for gains and losses, respectively (PDG/PDL). Afterwards, a subsample of 105 participants (44 with S/S, 6 with S/L, 55 with L/L genotype) completed the pharmacological study using a crossover design with tryptophan depletion (ATD), loading (ATL), and balanced (BAL) conditions. The same decision constructs were assessed. RESULTS: We found increased risk-seeking for losses in S/S compared to L/L individuals at the first visit (p = 0.002). Neither tryptophan depletion nor loading affected decision-making, nor did we observe an interaction between intervention and 5-HTTLPR genotype. CONCLUSION: Our data do not support the idea that transient changes of tonic 5-HT affect value-based decision-making. We provide evidence for an association of 5-HTTLPR with risk-seeking for losses, independent of acute 5-HT levels. This indicates that the association of 5-HTTLPR and risk-seeking for losses is mediated via other mechanisms, possibly by differences in the structural development of neural circuits of the 5-HT system during early life phases.

Intermittent compared to continuous real-time fMRI neurofeedback boosts control over amygdala activation.

Real-time fMRI neurofeedback is a feasible tool to learn the volitional regulation of brain activity. So far, most studies provide continuous feedback information that is presented upon every volume acquisition. Although this maximizes the temporal resolution of feedback information, it may be accompanied by some disadvantages. Participants can be distracted from the regulation task due to (1) the intrinsic delay of the hemodynamic response and associated feedback and (2) limited cognitive resources available to simultaneously evaluate feedback information and stay engaged with the task. Here, we systematically investigate differences between groups presented with different variants of feedback (continuous vs. intermittent) and a control group receiving no feedback on their ability to regulate amygdala activity using positive memories and feelings. In contrast to the feedback groups, no learning effect was observed in the group without any feedback presentation. The group receiving intermittent feedback exhibited better amygdala regulation performance when compared with the group receiving continuous feedback. Behavioural measurements show that these effects were reflected in differences in task engagement. Overall, we not only demonstrate that the presentation of feedback is a prerequisite to learn volitional control of amygdala activity but also that intermittent feedback is superior to continuous feedback presentation.

"Eyes Open - Eyes Closed" EEG/fMRI data set including dedicated "Carbon Wire Loop" motion detection channels.

This data set contains electroencephalography (EEG) data as well as simultaneous EEG with functional magnetic resonance imaging (EEG/fMRI) data. During EEG/fMRI, the EEG cap was outfitted with a hardware-based add-on consisting of carbon-wire loops (CWL). These yielded six extra׳CWL׳ signals related to Faraday induction of these loops in the main magnetic field "Measurement and reduction of motion and ballistocardiogram artefacts from simultaneous EEG and fMRI recordings" (Masterton et al., 2007) [1]. In this data set, the CWL data make it possible to do a direct regression approach to deal with the BCG and specifically He artifact. The CWL-EEG/fMRI data in this paper has been recorded on two MRI scanners with different Helium pump systems (4 subjects on a 3 T TIM Trio and 4 subjects on a 3T VERIO). Separate EEG/fMRI data sets have been recorded for the helium pump ON as well as the helium pump OFF conditions. The EEG-only data (same subjects) has been recorded for a motion artifact-free reference EEG signal outside of the scanner. This paper also links to an EEGlab "EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis" (Delorme and Makeig, 2004) [2] plugin to perform a CWL regression approach to deal with the He pump artifact, as published in the main paper "Carbon-wire loop based artifact correction outperforms post-processing EEG/fMRI corrections-A validation of a real-time simultaneous EEG/fMRI correction method" (van der Meer et al., 2016) [3].

Amygdala Regulation Following fMRI-Neurofeedback without Instructed Strategies.

Within the field of functional magnetic resonance imaging (fMRI) neurofeedback, most studies provide subjects with instructions or suggest strategies to regulate a particular brain area, while other neuro-/biofeedback approaches often do not. This study is the first to investigate the hypothesis that subjects are able to utilize fMRI neurofeedback to learn to differentially modulate the fMRI signal from the bilateral amygdala congruent with the prescribed regulation direction without an instructed or suggested strategy and apply what they learned even when feedback is no longer available. Thirty-two subjects were included in the analysis. Data were collected at 3 Tesla using blood oxygenation level dependent (BOLD)-sensitivity optimized multi-echo EPI. Based on the mean contrast between up- and down-regulation in the amygdala in a post-training scan without feedback following three neurofeedback sessions, subjects were able to regulate their amygdala congruent with the prescribed directions with a moderate effect size of Cohen's d = 0.43 (95% conf. int. 0.23-0.64). This effect size would be reduced, however, through stricter exclusion criteria for subjects that show alterations in respiration. Regulation capacity was positively correlated with subjective arousal ratings and negatively correlated with agreeableness and susceptibility to anger. A learning effect over the training sessions was only observed with end-of-block feedback (EoBF) but not with continuous feedback (trend). The results confirm the above hypothesis. Further studies are needed to compare effect sizes of regulation capacity for approaches with and without instructed strategies.

Carbon-wire loop based artifact correction outperforms post-processing EEG/fMRI corrections--A validation of a real-time simultaneous EEG/fMRI correction method.

Simultaneous EEG-fMRI combines two powerful neuroimaging techniques, but the EEG signal suffers from severe artifacts in the MRI environment that are difficult to remove. These are the MR scanning artifact and the blood-pulsation artifact--strategies to remove them are a topic of ongoing research. Additionally large, unsystematic artifacts are produced across the full frequency spectrum by the magnet's helium pump (and ventilator) systems which are notoriously hard to remove. As a consequence, experimenters routinely deactivate the helium pump during simultaneous EEG-fMRI acquisitions which potentially risks damaging the MRI system and necessitates more frequent and expensive helium refills. We present a novel correction method addressing both helium pump and ballisto-cardiac (BCG) artifacts, consisting of carbon-wire loops (CWL) as additional sensors to accurately track unpredictable artifacts related to subtle movements in the scanner, and an EEGLAB plugin to perform artifact correction. We compare signal-to-noise metrics of EEG data, corrected with CWL and three conventional correction methods, for helium pump off and on measurements. Because the CWL setup records signals in real-time, it fits requirements of applications where immediate correction is necessary, such as neuro-feedback applications or stimulation time-locked to specific sleep oscillations. The comparison metrics in this paper relate to: (1) the EEG signal itself, (2) the "eyes open vs. eyes closed" effect, and (3) an assessment of how the artifact corrections impacts the ability to perform meaningful correlations between EEG alpha power and the BOLD signal. Results show that the CWL correction corrects for He pump artifact and also produces EEG data more comparable to EEG obtained outside the magnet than conventional post-processing methods.

Flexible adaptive paradigms for fMRI using a novel software package 'Brain Analysis in Real-Time' (BART).

In this work we present a new open source software package offering a unified framework for the real-time adaptation of fMRI stimulation procedures. The software provides a straightforward setup and highly flexible approach to adapt fMRI paradigms while the experiment is running. The general framework comprises the inclusion of parameters from subject's compliance, such as directing gaze to visually presented stimuli and physiological fluctuations, like blood pressure or pulse. Additionally, this approach yields possibilities to investigate complex scientific questions, for example the influence of EEG rhythms or fMRI signals results themselves. To prove the concept of this approach, we used our software in a usability example for an fMRI experiment where the presentation of emotional pictures was dependent on the subject's gaze position. This can have a significant impact on the results. So far, if this is taken into account during fMRI data analysis, it is commonly done by the post-hoc removal of erroneous trials. Here, we propose an a priori adaptation of the paradigm during the experiment's runtime. Our fMRI findings clearly show the benefits of an adapted paradigm in terms of statistical power and higher effect sizes in emotion-related brain regions. This can be of special interest for all experiments with low statistical power due to a limited number of subjects, a limited amount of time, costs or available data to analyze, as is the case with real-time fMRI.

Neural control of vascular reactions: impact of emotion and attention.

This study investigated the neural regions involved in blood pressure reactions to negative stimuli and their possible modulation by attention. Twenty-four healthy human subjects (11 females; age = 24.75 ± 2.49 years) participated in an affective perceptual load task that manipulated attention to negative/neutral distractor pictures. fMRI data were collected simultaneously with continuous recording of peripheral arterial blood pressure. A parametric modulation analysis examined the impact of attention and emotion on the relation between neural activation and blood pressure reactivity during the task. When attention was available for processing the distractor pictures, negative pictures resulted in behavioral interference, neural activation in brain regions previously related to emotion, a transient decrease of blood pressure, and a positive correlation between blood pressure response and activation in a network including prefrontal and parietal regions, the amygdala, caudate, and mid-brain. These effects were modulated by attention; behavioral and neural responses to highly negative distractor pictures (compared with neutral pictures) were smaller or diminished, as was the negative blood pressure response when the central task involved high perceptual load. Furthermore, comparing high and low load revealed enhanced activation in frontoparietal regions implicated in attention control. Our results fit theories emphasizing the role of attention in the control of behavioral and neural reactions to irrelevant emotional distracting information. Our findings furthermore extend the function of attention to the control of autonomous reactions associated with negative emotions by showing altered blood pressure reactions to emotional stimuli, the latter being of potential clinical relevance.

Menstrual cycle phase modulates emotional conflict processing in women with and without premenstrual syndrome (PMS)--a pilot study.

BACKGROUND: Premenstrual syndrome (PMS) is characterized by a cluster of psychological and somatic symptoms during the late luteal phase of the menstrual cycle that disappear after the onset of menses. Behavioral differences in emotional and cognitive processing have been reported in women with PMS, and it is of particular interest whether PMS affects the parallel execution of emotional and cognitive processing. Related to this is the question of how the performance of women with PMS relates to stress levels compared to women without PMS. Cortisol has been shown to affect emotional processing in general and it has also been shown that women with severe PMS have a particular cortisol profile. METHODS: We measured performance in an emotional conflict task and stress levels in women with PMS (n = 15) and women without PMS (n = 15) throughout their menstrual cycle. RESULTS: We found a significant increase (p = 0.001) in the mean reaction time for resolving emotional conflict from the follicular to the luteal cycle phase in all subjects. Only women with PMS demonstrated an increase in physiological and subjective stress measures during the luteal menstrual cycle phase. CONCLUSIONS: Our findings suggest that the menstrual cycle modulates the integration of emotional and cognitive processing in all women. Preliminary data are supportive of the secondary hypothesis that stress levels are mediated by the menstrual cycle phase only in women with PMS. The presented evidence for menstrual cycle-specific differences in integrating emotional and cognitive information highlights the importance of controlling for menstrual cycle phase in studies that aim to elucidate the interplay of emotion and cognition.